[Previous] [Next] [Index] [Thread]

Site Scaning & IP graps



Can anyone tell me what the best way of detecting if a spider has had a look
at your server i.e is there a list of common spiders.

The story is there is a server here on site and while looking at the logs for
my own page I saw a number of sites that I have never heard off. The thing
is that there is no DNS entry for the server and it has not been advertised
only 10 or so people on site even know it exists .

I am just a little curious as to how people know about the server .


Follow-Ups: